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Motivation 


I want to program music: 

■ design algorithmic music patterns 

encode ideas rather than particular musical events 

a break barrier between notes and audio signal 

effects like reversed music or retarded record player 

□ real-time and interactive 
n declarative, reusable, with error-prevention 

■ integration with non-audio parts 

■ .. . and often I prefer text editors, search&replace with regular 
expressions, text-based version management 

to clicking through multiple layers of graphical dialogues 
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Haskell 


■ Functional non-strict programming paradigm 
—> direct translation of signal flow 
m General purpose programming language 
ready for other tasks than audio 
□ Statically polymorphically typed (Hindley-Milner system) 
—> error prevention 

a Type classes: automatic adaption to specific types 
—> reusable code 
a Compiled language 
—> efficient 

a Interactive programming 
—> live coding 
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Functional paradigm: Expression tree 



Lazy evalutation: structure code logically, compute chronologically 
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Functional paradigm: Feedback 
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Haskell problems 


In principle 

compiled = efficient 

but 

■ lazy evaluation comes at high run-time costs, 

□ optimizer too often misses optimization opportunities, 
a optimizer not available in interactive programming, 
n not yet support for vector computing (SSE, AltiVec). 

No problems in principle, but problems in current implementations. 


Martin-Luther-Universitat Halle-Wittenberg 



Institut fur Informatik 


Naturwissenschaftliche Fakultat III 

Agrar-, Geowissenschaften, Mathematik und Informatik 


Embedded Domain Specific Language 


a Domain Specific Language = Special Purpose Language 

□ Embedded = Use expressions of a host language 

The expression 

a + b 

■ does not mean “add a and b" 

□ but instead: 

“generate an addition command in another language” 
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Music EDSLs for Haskell 


EDSLs for Haskell exist for 
■ SuperCollider 
a Csound 


We use Low-Level Virtual Machine LLVM 

11 Compiler back-end - “portable high-level assembler” 
a Just-In-Time compiler 

tight integration with Haskell code 
a register allocation 

■ wide range of optimizations 

■ vector computing 

■ processor specific instructions 
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Examples for interactive programming 


pl 

ayMono (G 

en.osci Wave.sine 

0 

(hertz 

440)) 

pi 

ayMono 







(Gen.exp 

onential2 

(second 

1) 

1 * 



Gen.osc 

i Wave.tr: 

Langle 0 

(h 

ertz 440)) 

pl 

ayStereo 







(liftA2 

Stereo.cons 





(Gen . 

osci Wave 

triangle 

0 

(hertz 

439) ) 


(Gen . 

osci Wave 

triangle 

0 

(hertz 

441))) 



Martin-Luther-Universitat Halle-Wittenberg 





Institut fur Informatik 


Naturwissenschaftliche Fakultat III 

Agrar-, Geowissenschaften, Mathematik und Informatik 


What happens? 


■ Gen.osci, Gen.exponential generate LLVM loop bodies 
a “*” combines existing LLVM loop bodies 

a playMono closes the loop, runs the code and 
feeds generated signal data to the audio output 

□ See a disassembled LL file 

■ See a generated X86 assembly file 
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Types of signal generators 


exponential : : 

Float -> Float -> 

Generator (Value Float) 
exponential halfLife initialValue = ... 

osci : : 

(Value Float -> Code y) -> 

Float -> Float -> Generator y 
osci wave phase freq = ... 


Note: 

■ Higher order functions for waves 

■ Types prevent confusing mono with stereo signals 
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Change parameters without re-compilation 


Problem 1 : 

□ Playing the same instrument at different pitches requires 
recompilation 

Solution: 

□ Maintain a record of parameters 

for exchange between LLVM code and Haskell 

□ Turn instrument arguments into record selectors 

■ Constant parameters still hard-wired into LLVM code 

■ Parameters still expressed by number literals 
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Causality 


Problems 2a-c: 

■ Sharing 

input + delay input means, 
that input is computed twice 

□ Feedback 

let comb = input + delay comb in comb 
does not work 

■ Causal processes for real-time processing 
e.g. as needed for JACK 

“Causal”: every output sample depends exclusively 
on present and past input samples 
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Causal Arrows 


Turn 



□ Solve Sharing, Feedback, Causality problems 

□ Composition of causal arrows maintains causality 
a Instead of delay (amplify sig) 

write (delay . amplify) $* sig 

■ Multiple input and output: Causal (a,b) (c,d) 

■ Haskell provides special arrow syntax 
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Arrows 


h Arrows generalize functions 

■ many applications including hardware design and parsers 
a underlying concept of FAUST 
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Coping with filter parameters 


Problem 3: 

■ Frequency filters controlled by frequency f, resonance Q 

a Computing internal filter parameters from f, Q is expensive, 
but filter parameters may not change quickly 

□ Applying filters is cheap, 

but must be performed at audio sample rate 
Solution: Separate 

a filter parameter computation, 

■ rate adaption, 

■ filter application 
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Coping with filter parameters: other programs 


f,Q 

control rate 



audio rate 


filter 



audio rate 


a Csound, SuperCollider: 

Distinguish between control rate and audio rate 
■ ChucK: Update parameters on demand 
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Coping with filter parameters: our solution 



opaque internal filter parameters: p?j 
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Coping with filter parameters 


■ Filter parameter computation: 

select filter type, generate opaque filter parameter type 
□ Stretch signal of filter parameters 

a Type-class selects filter corresponding to filter parameter type 
Advantages: 

a Filter works exclusively at audio sampling rate (simple!) 

■ Different ways of specifying filter parameters 

■ Different control rates in the same program 

■ Irregular control rates, 

e.g. compute filter parameters if MIDI knob is turned 
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Vectorization 


Problem 4: 

■ SSE and AltiVec allow vector operations 

like parallel multiplication of four pairs of Float numbers 

■ How to support these operations? 

■ What to share between scalar and vector implementation? 
Solution: 

■ Divide signal into chunks of vector size 

■ New type of samples: Vector 

0 Re-use signal generator and arrow types 
a Full automatic vectorisation impossible, 
because user has to accept compromises 

■ Type-classes reduce code duplication 
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Expressiveness of Haskell’s types 


sample types 

a Value Float, Value Double 
o Stereo (Value a) 
a Complex (Value a) 
a Value Bool 
a Value Int32 


samples of various precisions 
... or quadro, surround 
Fourier coefficients 
for gate signals 
for counters 


Moog. Parameter D8 (Value a) filter parameters 

Value (LLVM. Array D6 (Order2.Parameter a)) 

Value (Vector D4 a) vectorized signal 

DimensionNumber Time (Value a) physical quantities 

Value a -> Code (Value b) each sample is a waveform 
combinations of type constructors 

custom types like newtype Cmp = Cmp (Value Int8)_ 



Sill 
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Expressiveness of Haskell’s types 


generator and process types 
a Generator (a,b) 

Two synchronous signal generators 

□ Causal a b 

type b samples depend causally on type a samples 

□ Generator a -> Generator b 

type b samples depend non-causally on type a samples 
a stateVariableFilter :: Causal (Param,a) (a,a,a) 
causal process with multiple inputs and outputs 
a frequencyModulation :: Generator a -> Causal t a 
output samples (type a) depend causally on frequency control 
(type t) but non-causally on input samples (type a) 


Martin-Luther-Universitat Halle-Wittenberg 



Institut fur Informatik 


Naturwissenschaftliche Fakultat III 

Agrar-, Geowissenschaften, Mathematik und Informatik 


Expressiveness of Haskell’s types 


type classes 

■ Share code between scalar and vector code 
a Share rate handling between filters 

a Use number literals and arithmetic operators 
for parameters, signals, causal processes. 
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Real-time software synthesizer 


a Compile code for instruments at startup 
a Receive MIDI events via ALSA sequencer 
0 Emit signal stream via ALSA PCM 

■ Vector computation, filter parameter update on controller 
changes, react to program changes . . . 
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Conclusions 


□ Haskell is ultimately cool 

■ really 

■ I swear 

■ makes you look like a wizard 
a everything else is toy 
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Conclusions 


Embedded Domain Specific Language 

n more low-level control, less declarativity 
a we get: general purpose, type-safety 
□ designing an EDSL has its own problems 
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Outlook 


■ make it nicer 

■ cleaner 

■ more intuitive to use 
a avoid memory leaks 

a tune garbage collector 

Get it from 

http:// code, haskell. org/ synthesizer/llvm/ 
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Questions 


How to configure a Linux machine, such that 
a it starts as few as possible things, 

0 starts a software synthesizer, 

a automatically connects a plugged USB keyboard to that 
soft-synth? 
wanted: 

m ALSA oscilloscope 

■ Audacity configurable for presentations: 
thick lines, better contrast 
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